Pandas Profiling Report

Dataset statistics

Number of variables	13
Number of observations	2973
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	290.5 KiB
Average record size in memory	100.0 B

Variable types

Numeric	13

Alerts

`gross_revenue` is highly correlated with `qty_invoices` and 4 other fields	High correlation
`recency_days` is highly correlated with `qty_invoices`	High correlation
`qty_invoices` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qty_itemns` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`qty_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_recency_days` is highly correlated with `frequency`	High correlation
`frequency` is highly correlated with `avg_recency_days`	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_unique_basket_size` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qty_invoices` and 1 other fields	High correlation
`qty_invoices` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qty_itemns` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`qty_products` is highly correlated with `qty_invoices`	High correlation
`avg_ticket` is highly correlated with `qty_returns` and 2 other fields	High correlation
`qty_returns` is highly correlated with `avg_ticket` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `avg_ticket` and 2 other fields	High correlation
`avg_unique_basket_size` is highly correlated with `avg_ticket` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qty_itemns` and 1 other fields	High correlation
`qty_invoices` is highly correlated with `qty_itemns`	High correlation
`qty_itemns` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`qty_products` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_recency_days` is highly correlated with `frequency` and 1 other fields	High correlation
`frequency` is highly correlated with `avg_recency_days`	High correlation
`qty_returns` is highly correlated with `avg_recency_days`	High correlation
`avg_basket_size` is highly correlated with `qty_itemns` and 1 other fields	High correlation
`avg_unique_basket_size` is highly correlated with `qty_itemns` and 1 other fields	High correlation
`gross_revenue` is highly correlated with `qty_invoices` and 6 other fields	High correlation
`qty_invoices` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qty_itemns` is highly correlated with `gross_revenue` and 6 other fields	High correlation
`qty_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_ticket` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`qty_returns` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_unique_basket_size` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_ticket` is highly skewed (γ1 = 53.48019807)	Skewed
`frequency` is highly skewed (γ1 = 24.89613265)	Skewed
`qty_returns` is highly skewed (γ1 = 51.83258039)	Skewed
`avg_basket_size` is highly skewed (γ1 = 44.70180648)	Skewed
`avg_unique_basket_size` is highly skewed (γ1 = 44.70180648)	Skewed
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`recency_days` has 34 (1.1%) zeros	Zeros
`qty_returns` has 1484 (49.9%) zeros	Zeros

Reproduction

Analysis started	2022-05-26 19:36:34.228851
Analysis finished	2022-05-26 19:38:24.592546
Duration	1 minute and 50.36 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	2973
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2320.551295

Minimum	0
Maximum	5725
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	0
5-th percentile	185.6
Q1	930
median	2122
Q3	3541
95-th percentile	5042.8
Maximum	5725
Range	5725
Interquartile range (IQR)	2611

Descriptive statistics

Standard deviation	1557.043184
Coefficient of variation (CV)	0.6709798604
Kurtosis	-1.009966708
Mean	2320.551295
Median Absolute Deviation (MAD)	1272
Skewness	0.3424128767
Sum	6898999
Variance	2424383.477
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3014	1	< 0.1%
3001	1	< 0.1%
3002	1	< 0.1%
3003	1	< 0.1%
3006	1	< 0.1%
3008	1	< 0.1%
3009	1	< 0.1%
3011	1	< 0.1%
3012	1	< 0.1%
Other values (2963)	2963	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5725	1	< 0.1%
5706	1	< 0.1%
5696	1	< 0.1%
5690	1	< 0.1%
5669	1	< 0.1%
5665	1	< 0.1%
5659	1	< 0.1%
5648	1	< 0.1%
5647	1	< 0.1%
5637	1	< 0.1%

customer_id
Real number (ℝ_≥0)

UNIQUE

Distinct	2973
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15269.75479

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	11.7 KiB

Quantile statistics

Minimum	12347
5-th percentile	12617.8
Q1	13799
median	15220
Q3	16767
95-th percentile	17964.4
Maximum	18287
Range	5940
Interquartile range (IQR)	2968

Descriptive statistics

Standard deviation	1718.870036
Coefficient of variation (CV)	0.1125669704
Kurtosis	-1.205091
Mean	15269.75479
Median Absolute Deviation (MAD)	1486
Skewness	0.03172900873
Sum	45396981
Variance	2954514.2
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
16185	1	< 0.1%
14626	1	< 0.1%
14868	1	< 0.1%
18246	1	< 0.1%
17115	1	< 0.1%
16611	1	< 0.1%
15912	1	< 0.1%
12670	1	< 0.1%
17588	1	< 0.1%
Other values (2963)	2963	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12363	1	< 0.1%
12364	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18277	1	< 0.1%
18276	1	< 0.1%
18274	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18269	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	2958
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2746.725883

Minimum	6.2
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	6.2
5-th percentile	229.92
Q1	570.5
median	1084.1
Q3	2306.52
95-th percentile	7211.22
Maximum	279138.02
Range	279131.82
Interquartile range (IQR)	1736.02

Descriptive statistics

Standard deviation	10573.74237
Coefficient of variation (CV)	3.849580488
Kurtosis	354.4086525
Mean	2746.725883
Median Absolute Deviation (MAD)	668.9
Skewness	16.78841992
Sum	8166016.05
Variance	111804027.6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2053.02	2	0.1%
331	2	0.1%
1078.96	2	0.1%
1025.44	2	0.1%
598.2	2	0.1%
533.33	2	0.1%
731.9	2	0.1%
379.65	2	0.1%
2092.32	2	0.1%
745.06	2	0.1%
Other values (2948)	2953	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
6.2	1	< 0.1%
13.3	1	< 0.1%
15	1	< 0.1%
36.56	1	< 0.1%
45	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
168472.5	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	272
Distinct (%)	9.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.37975109

Minimum	0
Maximum	373
Zeros	34
Zeros (%)	1.1%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	11
median	31
Q3	81
95-th percentile	242
Maximum	373
Range	373
Interquartile range (IQR)	70

Descriptive statistics

Standard deviation	77.75088394
Coefficient of variation (CV)	1.20769159
Kurtosis	2.765034542
Mean	64.37975109
Median Absolute Deviation (MAD)	26
Skewness	1.794156168
Sum	191401
Variance	6045.199953
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.3%
4	87	2.9%
2	85	2.9%
3	85	2.9%
8	76	2.6%
10	67	2.3%
7	66	2.2%
9	66	2.2%
17	64	2.2%
22	55	1.8%
Other values (262)	2223	74.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	34	1.1%
1	99	3.3%
2	85	2.9%
3	85	2.9%
4	87	2.9%
5	43	1.4%
7	66	2.2%
8	76	2.6%
9	66	2.2%
10	67	2.3%

Value	Count	Frequency (%)
373	2	0.1%
372	4	0.1%
371	1	< 0.1%
368	1	< 0.1%
366	4	0.1%
365	2	0.1%
364	1	< 0.1%
360	1	< 0.1%
359	1	< 0.1%
358	4	0.1%

qty_invoices
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	56
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.718466196

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	205
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	8.851499485
Coefficient of variation (CV)	1.547880005
Kurtosis	191.0363992
Mean	5.718466196
Median Absolute Deviation (MAD)	2
Skewness	10.77215129
Sum	17001
Variance	78.34904314
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	788	26.5%
3	500	16.8%
4	393	13.2%
5	237	8.0%
1	190	6.4%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	69	2.3%
10	55	1.8%
Other values (46)	332	11.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	190	6.4%
2	788	26.5%
3	500	16.8%
4	393	13.2%
5	237	8.0%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	69	2.3%
10	55	1.8%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	0.1%
60	1	< 0.1%
57	1	< 0.1%

qty_itemns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1671
Distinct (%)	56.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1607.347124

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	102.6
Q1	297
median	639
Q3	1399
95-th percentile	4406.6
Maximum	196844
Range	196843
Interquartile range (IQR)	1102

Descriptive statistics

Standard deviation	5883.760265
Coefficient of variation (CV)	3.660541134
Kurtosis	466.6007221
Mean	1607.347124
Median Absolute Deviation (MAD)	420
Skewness	17.87003689
Sum	4778643
Variance	34618634.85
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
150	9	0.3%
88	9	0.3%
288	8	0.3%
260	8	0.3%
246	8	0.3%
84	8	0.3%
272	8	0.3%
1200	7	0.2%
330	7	0.2%
Other values (1661)	2890	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	2	0.1%
12	2	0.1%
16	1	< 0.1%
17	1	< 0.1%
18	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
23	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%

qty_products
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	468
Distinct (%)	15.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	122.6152035

Minimum	1
Maximum	7838
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	9
Q1	29
median	67
Q3	135
95-th percentile	382
Maximum	7838
Range	7837
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	269.7316209
Coefficient of variation (CV)	2.199821989
Kurtosis	355.2780943
Mean	122.6152035
Median Absolute Deviation (MAD)	44
Skewness	15.71641959
Sum	364535
Variance	72755.14731
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28	43	1.4%
20	37	1.2%
35	35	1.2%
29	35	1.2%
19	34	1.1%
15	33	1.1%
11	32	1.1%
26	31	1.0%
27	30	1.0%
25	30	1.0%
Other values (458)	2633	88.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	6	0.2%
2	14	0.5%
3	16	0.5%
4	17	0.6%
5	26	0.9%
6	29	1.0%
7	18	0.6%
8	19	0.6%
9	26	0.9%
10	28	0.9%

Value	Count	Frequency (%)
7838	1	< 0.1%
5673	1	< 0.1%
5095	1	< 0.1%
4580	1	< 0.1%
2698	1	< 0.1%
2379	1	< 0.1%
2060	1	< 0.1%
1818	1	< 0.1%
1673	1	< 0.1%
1637	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	2970
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	51.85483961

Minimum	2.150588235
Maximum	56157.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	2.150588235
5-th percentile	4.919753553
Q1	13.12129032
median	17.97438356
Q3	24.97962963
95-th percentile	90.49133333
Maximum	56157.5
Range	56155.34941
Interquartile range (IQR)	11.85833931

Descriptive statistics

Standard deviation	1036.237034
Coefficient of variation (CV)	19.9834199
Kurtosis	2894.600567
Mean	51.85483961
Median Absolute Deviation (MAD)	5.977291363
Skewness	53.48019807
Sum	154164.4382
Variance	1073787.19
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14.47833333	2	0.1%
15	2	0.1%
4.162	2	0.1%
15.94088235	1	< 0.1%
22.8792623	1	< 0.1%
20.51104167	1	< 0.1%
149.025	1	< 0.1%
21.47435897	1	< 0.1%
12.949	1	< 0.1%
13.92736842	1	< 0.1%
Other values (2960)	2960	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
56157.5	1	< 0.1%
4453.43	1	< 0.1%
3202.92	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%

avg_recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1258
Distinct (%)	42.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	67.33918498

Minimum	1
Maximum	366
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	25.92857143
median	48.25
Q3	85.33333333
95-th percentile	201
Maximum	366
Range	365
Interquartile range (IQR)	59.4047619

Descriptive statistics

Standard deviation	63.52149965
Coefficient of variation (CV)	0.9433066299
Kurtosis	4.889771368
Mean	67.33918498
Median Absolute Deviation (MAD)	26.25
Skewness	2.062955526
Sum	200199.397
Variance	4034.980917
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14	25	0.8%
4	22	0.7%
70	21	0.7%
7	20	0.7%
35	19	0.6%
49	18	0.6%
46	17	0.6%
21	17	0.6%
11	17	0.6%
6	16	0.5%
Other values (1248)	2781	93.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	16	0.5%
1.5	1	< 0.1%
2	13	0.4%
2.5	1	< 0.1%
2.601398601	1	< 0.1%
3	15	0.5%
3.321428571	1	< 0.1%
3.330357143	1	< 0.1%
3.5	2	0.1%
4	22	0.7%

Value	Count	Frequency (%)
366	1	< 0.1%
365	1	< 0.1%
363	1	< 0.1%
362	1	< 0.1%
357	2	0.1%
356	1	< 0.1%
355	2	0.1%
352	1	< 0.1%
351	2	0.1%
350	3	0.1%

frequency
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1225
Distinct (%)	41.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.1136936504

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.008896801846
Q1	0.01633986928
median	0.02590673575
Q3	0.04945054945
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.03311068017

Descriptive statistics

Standard deviation	0.4078915909
Coefficient of variation (CV)	3.587637388
Kurtosis	990.6267355
Mean	0.1136936504
Median Absolute Deviation (MAD)	0.01218850234
Skewness	24.89613265
Sum	338.0112225
Variance	0.1663755499
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	198	6.7%
0.0625	18	0.6%
0.02777777778	17	0.6%
0.02380952381	16	0.5%
0.03448275862	15	0.5%
0.09090909091	15	0.5%
0.08333333333	15	0.5%
0.02941176471	14	0.5%
0.03571428571	13	0.4%
0.07692307692	13	0.4%
Other values (1215)	2639	88.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
3	1	< 0.1%
2	6	0.2%
1.142857143	1	< 0.1%
1	198	6.7%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%
0.5	3	0.1%

qty_returns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	214
Distinct (%)	7.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	62.07399933

Minimum	0
Maximum	80995
Zeros	1484
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	9
95-th percentile	100.4
Maximum	80995
Range	80995
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	1511.479652
Coefficient of variation (CV)	24.34964185
Kurtosis	2769.251267
Mean	62.07399933
Median Absolute Deviation (MAD)	1
Skewness	51.83258039
Sum	184546
Variance	2284570.738
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1484	49.9%
1	164	5.5%
2	149	5.0%
3	105	3.5%
4	89	3.0%
6	78	2.6%
5	61	2.1%
12	51	1.7%
8	43	1.4%
7	43	1.4%
Other values (204)	706	23.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1484	49.9%
1	164	5.5%
2	149	5.0%
3	105	3.5%
4	89	3.0%
5	61	2.1%
6	78	2.6%
7	43	1.4%
8	43	1.4%
9	41	1.4%

Value	Count	Frequency (%)
80995	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1980
Distinct (%)	66.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	249.779818

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.3
median	172.3333333
Q3	281.6923077
95-th percentile	600
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	178.3923077

Descriptive statistics

Standard deviation	791.0287722
Coefficient of variation (CV)	3.16690427
Kurtosis	2258.51001
Mean	249.779818
Median Absolute Deviation (MAD)	83
Skewness	44.70180648
Sum	742595.399
Variance	625726.5185
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
82	9	0.3%
73	9	0.3%
86	9	0.3%
60	8	0.3%
88	8	0.3%
136	8	0.3%
75	8	0.3%
288	7	0.2%
Other values (1970)	2886	97.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2801	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%

avg_unique_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1980
Distinct (%)	66.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	249.779818

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.4 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.3
median	172.3333333
Q3	281.6923077
95-th percentile	600
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	178.3923077

Descriptive statistics

Standard deviation	791.0287722
Coefficient of variation (CV)	3.16690427
Kurtosis	2258.51001
Mean	249.779818
Median Absolute Deviation (MAD)	83
Skewness	44.70180648
Sum	742595.399
Variance	625726.5185
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
82	9	0.3%
73	9	0.3%
86	9	0.3%
60	8	0.3%
88	8	0.3%
136	8	0.3%
75	8	0.3%
288	7	0.2%
Other values (1970)	2886	97.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2801	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qty_invoices	qty_itemns	qty_products	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_unique_basket_size
0	0	17850	5391.21	372.0	34.0	1733.0	297.0	18.152222	35.500000	17.000000	40.0	50.970588	50.970588
1	1	13047	3232.59	56.0	9.0	1390.0	171.0	18.904035	27.250000	0.028302	35.0	154.444444	154.444444
2	2	12583	6705.38	2.0	15.0	5028.0	232.0	28.902500	23.187500	0.040323	50.0	335.200000	335.200000
3	3	13748	948.25	95.0	5.0	439.0	28.0	33.866071	92.666667	0.017921	0.0	87.800000	87.800000
4	4	15100	876.00	333.0	3.0	80.0	3.0	292.000000	8.600000	0.073171	22.0	26.666667	26.666667
5	5	15291	4623.30	25.0	14.0	2102.0	102.0	45.326471	23.200000	0.040115	29.0	150.142857	150.142857
6	6	14688	5630.87	7.0	21.0	3621.0	327.0	17.219786	18.300000	0.057221	399.0	172.428571	172.428571
7	7	17809	5411.91	16.0	12.0	2057.0	61.0	88.719836	35.700000	0.033520	41.0	171.416667	171.416667
8	8	15311	60767.90	0.0	91.0	38194.0	2379.0	25.543464	4.144444	0.243316	474.0	419.714286	419.714286
9	9	16098	2005.63	87.0	7.0	613.0	67.0	29.934776	47.666667	0.024390	0.0	87.571429	87.571429

Last rows

	df_index	customer_id	gross_revenue	recency_days	qty_invoices	qty_itemns	qty_products	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_unique_basket_size
2963	5637	17727	1060.25	15.0	1.0	645.0	66.0	16.064394	6.0	1.000000	6.0	645.000000	645.000000
2964	5647	17232	421.52	2.0	2.0	203.0	36.0	11.708889	12.0	0.153846	0.0	101.500000	101.500000
2965	5648	17468	137.00	10.0	2.0	116.0	5.0	27.400000	4.0	0.400000	0.0	58.000000	58.000000
2966	5659	13596	697.04	5.0	2.0	406.0	166.0	4.199036	7.0	0.250000	0.0	203.000000	203.000000
2967	5665	14893	1237.85	9.0	2.0	799.0	73.0	16.956849	2.0	0.666667	0.0	399.500000	399.500000
2968	5669	12479	473.20	11.0	1.0	382.0	30.0	15.773333	4.0	1.000000	34.0	382.000000	382.000000
2969	5690	14126	706.13	7.0	3.0	508.0	15.0	47.075333	3.0	0.750000	50.0	169.333333	169.333333
2970	5696	13521	1092.39	1.0	3.0	733.0	435.0	2.511241	4.5	0.300000	0.0	244.333333	244.333333
2971	5706	15060	301.84	8.0	4.0	262.0	120.0	2.515333	1.0	2.000000	0.0	65.500000	65.500000
2972	5725	12558	269.96	7.0	1.0	196.0	11.0	24.541818	6.0	1.000000	196.0	196.000000	196.000000

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows